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BACKGROUND OF THE INVENTION 



Field of the Invention 

The present invention relates to detection of data in a communications system, and, more 
particularly, to compensation for signal dispersion in an optical fiber. 

10 Cross-Reference to Related Applications 

* This application claims the benefit of the filing date of U.S. provisional application no. 

i 60/280,326, filed on 03/30/01 as attorney docket no. Bessios 3PROV. 



into an encoded (e.g., error-correction encoded) and/or packetized stream of data. The stream of data is 
then divided into discrete blocks. Each of the blocks may be mapped onto a corresponding one of a 
sequence of code or symbol values ("symbols") chosen from a pre-defined alphabet A, and generated with 
a period T s , sometimes referred to as the "baud" rate. For optical transmission of the digital information, 



20 an optical carrier operating with a wavelength of, for example, 1 3 1 0 nm or 1 550 nm, is modulated with the 
encoded stream of data. The modulated optical carrier is then passed through an optical fiber, such as a 
single mode fiber (SMF) having its lowest order bound propagating at 13 10 nm or 1550 nm. 

The modulated optical signal transmitted through the optical fiber comprises a series of light 
pulses. Since a transmission medium may be modeled as a filter having a corresponding (frequency- 

25 domain) transfer function and (time-domain) impulse response, the pulse transmitted through the optical 
fiber may be modified based on this transfer function. The pulse shape may be modified in amplitude and 
phase, and also experience dispersion of the pulse. Consequently, the time duration of the pulse 
transmitted through a medium may extend over a period of time greater than the time duration of a 
particular symbol. Adjacent pulses transmitted through the medium may thus corrupt each other, which 

30 corruption is known as inter-symbol interference (ISI). As bit rates in optical communication systems 
increase for high speed data transmission, such as rates above 10 Gbps, receivers are increasingly faced 
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Description of the Related Art 



In many digital communications systems, a user generates digital information that is then converted 



with mitigating effects of pulse dispersion and inter-symbol interference (ISI). A receiver typically 
includes a detector forming decisions for received, sampled channel output data ("receive signal") 
corresponding to the transmitted pulses. These detectors may apply compensation/equalization to the input 
samples of the received signal, and employ algorithms such as maximum-likelihood sequence detection to 
reconstruct the sequence of pulses in the transmitted, encoded stream of data. 

For optical communication systems, there are several sources of pulse dispersion through an SMF. 
A first source of dispersion is chromatic dispersion that causes time-domain pulse broadening due to the 
different traveling velocities of each optical pulse's spectral components. Prior art methods of 
compensation for chromatic dispersion use an opposite dispersion-compensating fiber (DCF) that has a 
greater dispersion parameter, usually by a factor of 10. 

A second source of dispersion is polarization mode dispersion (PMD) that arises from 
imperfections in the circular symmetry of the fiber core. Imperfections typically are from manufacturing 
flaws, chemical impurities, and/or excessive bending/ strain during installation. Imperfect circular 
symmetry results in bi-refringent SMF that causes two orthogonal principal polarization states (PPS) to 
propagate with different velocities through the fiber core. The average differential group delay (DGD) is 
proportional to the square-root of the transmission distance. For example, an SMF having PMD of 

10ps/ 4Z , where L is the distance in kilometers, has a DGD of \00ps (100 pico-seconds) at a distance of 
100km. At distances greater than 100km and bit rates greater than 10 Gbps, the effects of DGD become 
significant when compared to the symbol period (75=1 OOps at 10 Gbps for non-return-to-zero (NRZ) line 
coding). For a 10 Gbps transmission data rate, the magnitude of the maximum value for the mean DGD 
{tJ) between two orthogonal PPSs has an upper bound of \00ps (i.e., (t d ) < lOOps). 

The (SMF) channel may be modeled as a two-symbol dispersive channel with impulse response 
h{t\ and the model for a 10 Gbps channel that reflects statistical differential delay between the two PPS 
components may be as given in equation (1): 



with 8(-) defined as the delta function, with (oc/(l -a)) defined as the power distribution ratio among the two 
orthogonal PPSs, and with r d following a Maxwell distribution as given in equation (2): 




0) 




(2) 
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ISI results in multi-level channel output values due to the effect of the channel's memory on the 
binary input levels, causing degradation of a receiver's bit error rate (BER) performance. Linear ISI and 
time-varying PMD effects are generally compensated by using adaptive equalization. 



5 SUMMARY OF THE INVENTION 

The present invention relates to non -linear threshold compensation to adjust input sample values 
from a single mode fiber to mitigate effects of polarization mode dispersion. In accordance with an 
exemplary embodiment of the present invention, compensation is applied to samples received from an 
optical channel by generating a decision for a current sample and a previous sample based on a threshold, 
10 and generating a decision difference between the decisions for the current and previous samples as an 

estimate of the direction ("sign/phase") of decision transition. An error signal is generated as a difference 
p between the current sample and the decision for the current sample; and a sample difference is generated 

S n 5 

J*: between the current and previous samples. A magnitude of correction is combined with the sign/phase to 
%\ create a correction value, wherein the magnitude of the correction combined with the sign/phase is selected 

j!f 5 based on the sample difference, the error signal, and the sign/phase; and the correction value is applied to 

U 

a the current sample to apply compensation. 

ft! 

fll 

U BRIEF DESCRIPTION OF THE DRAWINGS 

jw Other aspects, features, and advantages of the present invention will become more fully apparent 

20 from the following detailed description, the appended claims, and the accompanying drawings in which: 

FIG. 1 shows a block diagram of a decision circuit incorporating non-linear threshold 
compensation (NLC) in accordance with an exemplary embodiment of the present invention; 

FIG. 2 shows graphs illustrating BER performance of a slicer with and without (NLC) in 
accordance with exemplary embodiments of the present invention given DGD of lOps; 

25 FIG. 3 shows graphs illustrating BER performance of a slicer with and without (NLC) in 

accordance with exemplary embodiments of the present invention given DGD of 1 OOps; 

FIG. 4 shows graphs illustrating noise performance of a slicer with and without NLC in accordance 
with exemplary embodiments of the present invention given DGD of lOQps; 

FIG. 5 shows graphs illustrating BER optimization as a function of sampling phase for a slicer 
30 with and without NLC in accordance with exemplary embodiments of the present invention; 
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FIG. 6 shows graphs illustrating BER optimization as a function of threshold for a slicer with and 
without NLC in accordance with exemplary embodiments of the present invention; 

FIG. 7 shows the circuit of FIG. 1 incorporating logic for selecting the magnitude of correction for 
fixed threshold level; 

5 FIG. 8 shows the circuit of FIG. 1 incorporating logic for selecting the magnitude of correction for 

adaptive threshold level for first-order symbol transitions; and 

FIG. 9 shows the circuit of FIG. 1 incorporating logic for selecting the magnitude of correction for 
adaptive threshold level for first- and second-order symbol transitions. 



10 DETAILED DESCRIPTION 

O FIG. 1 shows a block diagram of a decision circuit incorporating non-linear threshold 

£3 

1 1 compensation (NLC) in accordance with an exemplary embodiment of the present invention. Circuit 100 

P includes a first data path having slicer 102; combiner 107 and magnitude operator 108 generating error 

SI 

If- signal e; a second data path having delay 101 and slicer 103; combiner 104 and magnitude operator 105 

d 5 generating the signal d\ a compensation path having combiner 1 06, multiplier 1 09, and combiner 1 1 0; and 

s 

i,„l a decision device comprising slicer 111. 

W The exemplary embodiment of FIG. 1 is described with reference to average differential group 

1^ delay (DGD) of 1 OOps and 70ps for data transmitted through a single mode fiber (SMF) with symbol 
p period Tf=l OOps at 10 Gbps (with NRZ line coding) and with a channel model as described in equations 
20 (1) and (2). In addition, the present invention is described given that, during acquisition, relatively good 
sampling phase is achieved (i.e., the sampling clock of the received signal generating input samples is 
relatively close in phase to the phase of the transmitter clock). However, one skilled in the art may readily 
extend the teachings herein to other optical transmission channels having different differential group delay 
and different channel models. In addition, the present invention is described for systems with processing 
25 with normalized data and sample values. One skilled in the art would realize that the various equations, 

variables, and thresholds described herein may be scaled or adjusted by constants as determined for a given 
application. 

Non-linear threshold compensation operates as follows. In the first data path, slicer 102 forms a 
decision for the input sample y k at time k based on a threshold L. In the second data path, delay 101 delays 
30 the input data samples by one sample, and thus, at time slicer 103 forms a decision based on a threshold 
L for the previous sample^./. The difference S is generated by combiner 106 as the difference between the 
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values provided from the first and second paths, which is the difference between i) the decision for the 
current input sample and ii) the decision for the previous input sample. The value of the difference S 
indicates whether a transition between logic values has occurred in the input data, and represents the 
direction (sign/phase) of the transition. An optional divider (not shown in FIG. 1) may be used to divide 
the value of S by 2 to generate a +1, 0, or -1 value corresponding to the direction of transition. This 
division by 2 may be desirable if slicers 102 and 103 generate values of +1 or -1 for decisions. 

In addition to value S, two values are generated to determine the magnitude c of the correction 
input to multiplier 109. Combiner 107 and magnitude operator 108 generate a magnitude of an error signal 
e defined as the magnitude of the difference between i) the decision generated by slicer 102 and ii) the 
input sample^. Combiner 104 and magnitude operator 105 generate the magnitude d of the difference 
between i) the current input sample and ii) the previous input sample. The value for the difference d 
represents a relative "closeness" in value between two consecutive input samples. 

The magnitude c of a correction combined in multiplier 109 with the sign/phase represented by S is 
dependent upon the current state of S, e, and d. The magnitude c of the correction for the exemplary 
embodiment of FIG. 1 may be as given in equation (3): 

'y k9 ifS<0,\e\<03 



c = < 



l-y k9 if S>0 9 \e\<0.3 9 \d\> 0.13 (3) 
0, Otherwise 



Thresholds for the magnitudes of e and d may be determined experimentally through simulation and 
observation, such as described subsequently with respect to Table 1. 

As shown in equation (3), the decision for which correction to apply is based on detection of the 
presence or absence of a data transition as indicated by S 9 closeness in value between two consecutive 
input samples as indicated by d 9 and the error between the current sample and the decision for the current 
sample as indicated by e. When the magnitude c of the correction is combined with S, the result is a 
correction value that approximates the dispersion effect of the previous data value contained in the current 
sample. The correction value is then combined with the current sample^ in combiner 1 10 to generate a 
compensated sample. The compensated sample is then applied to slicer 1 1 1 that generates a hard decision 
for the compensated sample at time k. For normalized data, the threshold for slicer 1 1 1 is shown as 0.5. 

Observation of transmitted data patterns for bit combinations up to three bits through an SMF at 10 
Gbps allows for generation of a table of rules for a range (normalized between 0 and 1) of values for the 
current sample^ given the previously transmitted data bits. These rules are based on the contributions of 
previous bit values d k . } and d k _ 2 to the current sample y k corresponding to the current bit d h For receiver 
100, Table 1 summarizes an exemplary list of rules. In Table 1 corresponds to a logic "1" transmitted 
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as a pulse with a given shape, and corresponds to a logic "0" transmitted as a pulse with the inverse of 
the given shape, and y k is the input sample corresponding to the last symbol in column 1. 

Table 1 



Transmitted Data Pattern 


Range ioxy k with DGD=100pi 


Range for y k with DGD=70ps 


+ - 


[0.20, 0.35] 


[0.20, 0.35] 




-0.20 


[0.00, 0.10] 




[0.00, 0.10] 


[0.00. 0.005] 


- + 


[0.60, 0.75] 


[0.55, 0.65] 


- + + 


[0.90, 1.00] 


[0.9, 1.00] 


+ + + 


[0.95, 1.00] 


[0.95, 1.00] 



f*\ 5 For Table 1 , the worst case PMD data with either lOps or 1 OOps DGD includes up to a 2-level 

effect on the current symbol level. Consequently, the threshold levels L of each slicer 1 02 and 1 03 in FIG. 

ill 

%l 1 may be set according to the listed ranges of Table 1 . For example, from Table 1 a threshold L for a 

|H current decision given the previous sample decision was would be set between the ranges of [0.02, 

*' 0.35] and [0.90, 1 .00], such as 0.65. As decisions are generated for data, threshold value L may be 

;t0 modified given the decisions for previous samples. In addition, from Table 1 a threshold L for a current 

irjj decision given the previous sample decision was would be set between the ranges of [0.00, 0.20] and 

J*J [0.60, 0.75], such as 0.4. Preferred embodiments of the present invention modify L only when a transition 

y, between input samples is detected. 

FIGs. 2-6 show experimental results comparing the performance of a receiver employing a slicer 
1 5 only to generate decisions for input samples, .and a receiver employing non-linear compensation in 

accordance with embodiments of the present invention. As shown in the figures, employing non-linear 
threshold compensation in accordance with one or more embodiments of the present invention may 
improve BER performance, and related SNR performance, of a receiver. 

FIG. 2 shows graphs illustrating bit error rate (BER) performance of a slicer with (dashed line) and 
20 without (solid line) non-linear threshold compensation (NLC) in accordance with exemplary embodiments 
of the present invention given DGD of 70ps. As shown in FIGs. 2A-2D, the gain of the slicer with NLC is 
up to 2 orders of magnitude lower SNR. FIG. 2 A is a graph of BER versus signal-to-noise ratio (SNR) for 
a sampling phase of 5 (SP=5) and threshold L of 0.35. FIG. 2B is a graph of BER versus SNR for a 
sampling phase of SP=5 and threshold L of 0.25. FIG. 2C is a graph of BER versus SNR for a sampling 
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phase of 8 (SP=8) and threshold L of 0.35. FIG. 2D is a graph of BER versus SNR for a sampling phase 
of SP=8 and threshold/, of 0.25. 

FIG. 3 shows graphs illustrating BER performance of a slicer with (dashed line) and without (solid 
line) NLC in accordance with exemplary embodiments of the present invention given DGD of lOOps. As 
shown in FIGs. 3A-3D, the gain of the slicer with NLC is up to 2 orders of magnitude lower SNR. FIG. 
3A is a graph of BER versus SNR for a sampling phase of 5 (SP=5) and threshold L of 0.3. FIG. 3B is a 
graph of BER versus SNR for a sampling phase of SP=5 and threshold L of 0.25. FIG. 3C is a graph of 
BER versus SNR for a sampling phase of 8 (SP=8) and threshold L of 0.3. FIG. 3D is a graph of BER 
versus SNR for a sampling phase of SP=8 and threshold L of 0.25. 

FIG. 4 shows graphs illustrating noise performance of a slicer with (dashed line) and without (solid 
line) NLC in accordance with exemplary embodiments of the present invention given DGD of 100/w. 
FIG. 4A is a graph of BER versus SNR for a simulation with a sampling phase of 5 (SP=5) and threshold 
L of 0.3, and FIG. 4B is a graph of data value amplitudes versus sp (baud-rate sampling time) without 
added noise and without compensation. FIG. 4C is a graph of data value amplitudes versus sp (baud-rate 
sampling time) with added (white Gaussian) noise but without compensation, while FIG. 4DC is a graph of 
data value amplitudes versus sp (baud-rate sampling time) with added (white Gaussian) noise and with 
NLC. Comparing FIGs. 4C and 4D illustrates improvement in noise margin when a slicer employs NLC in 
accordance with an exemplary embodiment of the present invention. 

FIG. 5 shows graphs illustrating BER optimization as a function of sampling phase for a slicer with 
(dashed line) and without (solid line) NLC in accordance with exemplary embodiments of the present 
invention. FIG. 5 A shows BER optimization as a function of sampling phase for an SNR of 25dB and 
threshold of 0.6 for DGD of 50ps. FIG. 5B shows BER optimization as a function of sampling phase for 
SNR of 25dB and a threshold of 0.25 for DGD of 70ps. FIG. 5C shows BER optimization as a function of 
sampling phase for SNR of 25dB and a threshold of 0.35 for DGD of 70ps. FIG. 5D shows BER 
optimization as a function of sampling phase for SNR of 25dB and a threshold of 0.3 for DGD of \00ps. 

FIG. 6 shows graphs illustrating BER optimization as a function of threshold for a slicer with 
(dashed line) and without (solid line) NLC in accordance with exemplary embodiments of the present 
invention for sampling phases of 14 (FIG. 6A), 5 (FIG. 6B), 8 (FIG. 6C), and 6 (FIG. 6D). 

FIG. 7 shows the circuit of FIG. 1 incorporating logic for selecting the magnitude of correction for 
fixed threshold level. As shown in FIG. 7, multiplexers (muxes) 702, 703, and 704, and adder 701 
implement the tests of equation (3) above. Adder 705 and divider 706 are employed to generate logic 1 or 
0 from S for mux 703. FIG. 8 shows the circuit of FIG. 1 incorporating logic for selecting the magnitude 
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of correction for adaptive threshold level for first-order symbol transitions. The circuit of FIG. 8 is similar 
to that of FIG. 7 for fixed threshold, except that only one slicer, sheer 102, is used with delay 801 to 
generate current and previous sample decisions. Slicer 102 employs a threshold (0.5 + Li\ where L\ is 
adaptively set based on the combination of 1) the difference between the current and previous output 
decisions of slicer 102, and 2) a constant l } determined from the particular transition from, for example, 
Table 1. Since only one symbol transition is used, the circuit of FIG. 8 adapts the threshold for first-order 
symbol transitions (i.e., a current transition from the previous to the current sample including effects of the 
previous sample). FIG. 9 shows the circuit of FIG. 1 incorporating logic for selecting the magnitude of 
correction for adaptive threshold level for first- and second-order symbol transitions (i.e., a second order 
transition is the current transition including effects of both prior symbols). The circuit of FIG. 9 differs 
from the circuit of FIG. 8 by slicer 102 having its threshold of (0.5 + Lj + L 2 \ where L 2 is adaptively set 
based on 1) the previous difference between output decisions of slicer 102, and 2) constant h determined 
from the particular transition from, for example, Table 1. 

While the exemplary embodiments of the present invention have been described with respect to 
processes of circuits, the present invention is not so limited. As would be apparent to one skilled in the art, 
various functions of circuit elements may also be implemented in the digital domain as processing steps in 
a software program. Such software may be employed in, for example, a digital signal processor, micro- 
controller or general purpose computer. 

The present invention can be embodied in the form of methods and apparatuses for practicing 
those methods. The present invention can also be embodied in the form of program code embodied in 
tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other machine-readable storage 
medium, wherein, when the program code is loaded into and executed by a machine, such as a computer, 
the machine becomes an apparatus for practicing the invention. The present invention can also be 
embodied in the form of program code, for example, whether stored in a storage medium, loaded into 
and/or executed by a machine, or transmitted over some transmission medium, such as over electrical 
wiring or cabling, through fiber optics, or via electromagnetic radiation, wherein, when the program code 
is loaded into and executed by a machine, such as a computer, the machine becomes an apparatus for 
practicing the invention. When implemented on a general-purpose processor, the program code segments 
combine with the processor to provide a unique device that operates analogously to specific logic circuits. 

It will be further understood that various changes in the details, materials, and arrangements of the 
parts which have been described and illustrated in order to explain the nature of this invention may be 
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made by those skilled in the art without departing from the principle and scope of the invention as 
expressed in the following claims. 
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